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VALIDITY  ANALYSIS  OF  TOOL  AND  TRADE  KNOWLEDGE  TEST  ITEMS 


BACKGROUND 


The  Army  Classification  Battery  (ACB)  consists  of  11  tests  of  varied  con¬ 
tent,  designed  to  provide  the  hasis  for  optimal  differential  classification  of 
enlisted  men  for  training  in  Military  Occupational.  Specialties  (MOS) .  Most  of 
the  tests  were  originally  constructed  and  standardized  during  World  War  II. 
Research  has  been  conducted  continuously  since  19^9  to  maintain  and  improve  the 
ACB,  to  check  the  validity  of  tests  and  composites,  and  to  extend  the  scope  of 
the  battery's  effectiveness  to  additional  MOS.  New  tests  have  been  introduced 
and  new  forms  have  replaced  existing  tests  to  avoid  obsolescence  of  content  and 
to  counter  growing  familiarity  of  examinees  with  test  content.  Research  has 
yielded  replacement  measures  for  the  Verbal,  Arithmetic  Reasoning,  and  Elec¬ 
tronics  Information  Tests  in  1957 >  and.  for  the  Army  Clerical  Speed  Test  and 
Automotive  Information  Test  in  19 62.  Two  new  measures,  the  Classification  In¬ 
ventory  and  the  General  Information  Test,  were  introduced  in  1958-  The  remain¬ 
ing  four  tests — Pattern  Analysis,  Mechanical  Aptitude,  Army  Radio  Code  Aptitude, 
and  Shop  Mechanics — have  been  unchanged  since  the  inception  of  the  ACB.  The 
present  study  constituted  a  step  toward  replacement  of  two  measures  used  for 
classification  to  MOS  in  the  mechanical  domain:  Mechanical  Aptitude  (MA),  a 
component  of  the  Electronics  and  Motor  Maintenance  Aptitude  Areas ,  and  Shop 
Mechanics  (SM),  a  component  of  the  General  Maintenance  Aptitude  Area. 

When  ACB  measures  are  to  be  replaced,  the  question  arises  as  to  whether 
up-to-date  parallel  forms  of  existing  tests  or  measures  of  a  new  and  different 
type  would  most  improve  the  differential  validity  of  the  battery.  The  crucial 
consideration  is  not  the  zero -order  validity  of  the  measure  to  be  replaced,  but 
its  validity  for  differential  classification.  In  a  comprehensive  study  of  ACB 
validity  for  73  Army  School  MOS  courses  across  all  non -combat  occupational  areas 
(Helme,  i960),  "The  Mechanical  Aptitude  Test  and  the  Shop  Mechanics  Test  appeared 
to  offer  little  prospect  of  differential  selection  within  the  broad  mechanical 
field.  Replacements  for  these  tests  should  be  based  on  a  realignment  of  existing 
content,  and  on  inclusion  of  content  more  pertinent  to  specific  mechanical  Job 
areas."  An  experimental  Tool  Knowledge  Test,  emphasizing  aptitude  for  working 
with  mechanical  tools  and  processes  rather  than  comprehension  of  mechanical  and 
physical  principles,  and  two  experimental  Trade  Knowledge  tests  designed  to  dif¬ 
ferentiate  as  well  as  possible  among  Precision  Maintenance  occupational  Job 
areas ,  and  among  various  military  crafts  Jobs  such  as  Construction  (Mos  with 
first  two  digits  51),  Chemical  (53),  and  fuel  and  industrial  gas  production  (57), 
were  constructed  (Helme,  Kotula,  Tracey  and  Anderson,  April  i960)  for  possible 
inclusion  in  the  ACB. 


CONSTRUCTION  OF  EXPERIMENTAL  MECHANICAL  INFORMATION  TESTS 


THE  ITEM  POOLS 


To  provide  content  mere  pertinent  to  specific  Job  areas  within  the  broad 
me-hanl-al  domain,  a  large  pool  of  items  of  mechanical  information  was  con- 
strutted  with  the  assistance  of  Army  enlisted  subject  matter  experts  and  the  use 
of  both  military  and  civilian  technical  manuals.  These  experimentaiitemswere 
based  on  selected  groups  of  MOS  not  specifically  represented  in  the  content  of 
MA  and  SM  Wire  Maintenance,  Electrical  Equipment  Maintenance,  Construction,  ^ 
Utilities,  Fuel  and  Industrial  Gas  Production,  and  Engineer  Equipment  Operation 
and  Maintenance.  A  small  set  of  general  content  tool  items,  common  to  a  wide 
range  of  mechanical  Jobs,  was  added  While  these  measures  were  designed  to  re¬ 
place  and  extend  the  mechanical  information  content  of  MA  and  SM,  no  items  on 
physical  and  me:bani:a-  prmciples--which  make  up  6?  percent  o.  MA  and  35  per¬ 
cent  of  SM-  were  included  Table  1  shows  the  composition  of  the  three  experi¬ 
mental  forms  by  content  area.  After  editing,  revision,  and  allocation  of  items 
t:  content  area  in  rough  proportion  to  annual  personnel  replacement  requirements, 
the  items  were  assembled  in  three  experimental,  tests: 


1.  Tool  Knowledge.  TK.-1X.  'PT  ^961)  120  items,  of  which  about  two-thirds 

involve  recognition  of  pictures  of  tools  and  association  vith  use.  The  remainder 
are  infoaL  questions  on  tools 


2,  Trade  Knowledge,  TFK-1X  {PT  196;)  .110  items  on  specific  trade  opera¬ 

tions,  of  which  about  one -four t h  involve  illustrations. 

3„  Trade  Knowledge,  TPK-1.Y  >T  3^6; )  A  form  parallel  in  content  and 
forma1;  to  TFK-1X 


SCOPE  OF  PRESENT  ANALYSIS 


The  objective  of  the  present  analysis  was  to  develop  experimental  scales  for 
the  differential  prediction  of  performance  in  construction  and  related  mechanical 
Jobs  The  present  report  covers  analysis  of  items  for  (l)  difficulty  level  in 
sample"  representative  of  the  Army  input  population  and  (2)  validity  for  perform¬ 
ance  in  selected  electrical,  maintenance  and  engineer  construction  training 
courses.  A  necessary  intermediate  step  in  the  analysis  was  to  determine  whether 
item  statistics  in  relatively  small  samples  representative  of  individual  MOS  or 
MOS  of  near  equivalent  requirements  would  be  sufficiently  stable  to  constitute  a 
basis  for  predictive  scales  which  could  be  cross  validated  in  subsequent  studies. 
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Table  1 


DISTRIBUTION  OF  TOOL  AND  TRADE  KNOWLEDGE  ITEMS  BY  CONTENT  CATEGORY 


Tool  Knowledge  Items 

Trade  Knowledge  Items 

Content  Category 

(Form  TK-1X) 

(Forms  TRK-1X,  TRK-1Y ) 

Electrical 

15 

48 

Carpentry 

39 

36 

Plumbing,  Heating,  Refrigeration 

15 

28 

Masonry,  Quarrying 

l6 

28 

Construction  Machinery  Operator 

— 

28 

Water  and.  Industrial  Gas  Supply 

— 

l6 

Rigging 

— 

20 

Steel  Structures  Construction 

— 

16 

Machinist 

5 

— 

Painting  and  Paperhanging 

6 

— 

Miscellaneous 

24 

— 

|  Totals 

120 

220 

PROCEDURE 


TATA  COLLECTION 

The  three  expe  r  ime  >  ■  ca .  f  o/ms  /ere  a  inu.nl  star  eh  to  a  sample  of  general  en¬ 
listed  input  and  samples  of  input  he  MDS  training  programs  from  September  i960  to 
September  196]  af  the  Reception  Station  a.ni  Engineer  Training  Center,  Fort 
Leonard  Wool  Missouri,  the  Erg-ines-*  Schorl,  Fort  Belvoir,  Virginia,  and  the 
Southeastern  Signal  S’hool,  Fort  Gordin,  Georgia  The  Reception  Station  (general 
input)  sample  vas  tested,  a*  tne  ♦  ime  of  ACT  testing;  the  M9S  training  input  sam¬ 
ple  vote  tested  jus*  prior  to  beginning  the  respective  training  programs  Each 
examinee  v°*  giver.  • “ e  Toil  Knowledge  Test  and  one  of  the  Trade  Knovledge  forms. 
In  addition,  scores  on  A‘B  tests  were  obtained  from  the  Enlisted  Qualification 
Record,  DA  Form  5C  Fr  om  examinees  admen  is he>-“i  each  of  the  two  Trade  KhovLedge 
Tests,  five  MOS  -  ample s  were  mi '  rally  set  up  (Table  2) , 


ITEM  SELECTION 

For  seen  valiia •  ;  ;n  samp e,  A  I.  thr  : .ugh  A -5  and  B-l  through  B-5,  point,  bi- 
serii.i  correi.af  ion  ' :  r  f :  ?n'~  of  eac  -  item  response  with  final  course  grade 

were  obtained  in  ".  of  these  sample*  .  and  in  "tie  general  enlisted  input  sam¬ 
ples,  A -6  and  E  -b  the  i- :.p  • '  t ion?  giving  each  response  were  determined. 

In  sale*  ring  items,  *he  in*  a.,  step  -was  to  eliminate  from  consideration  ail 
items  an?v»r ei  <-  :,*r?-  *  ;y  by  less  ♦►.«  1C  par  an*  or  more  than  90  percent  of  the 
genera,  mp  sample:  ( ’.•  t  tn::  c  its®?  .  the  me  orreoted  p -values  correspond¬ 
ing  *  10  percent  am  90  pc--  rnt  ere  .  5?-5  and  •9?5,  respectively.)  By  these 

standards  >0=  Tool  Kn:  -  elate  Test  was  relmej  from  120  to  100  items  and  the  two 
1.1.0- item  Trade  kn-’Vl  edge  Te;  *•:•  TPF  X  ari  .Y  *o  85  and  75  items,  respectively.. 

The  second  step  was  nrn'iv  i*ems  with  validity  significantly  different 
from  zero  on  9.  positive  urec*. tor.  in  ee.co  samp,.e  Table  3  shows  that  the  number 
of  items  identified  as  vain  in  a  gioen  sample  ranged  from  1?  to  71 

At  this  point  it  vos  necessary  to  marshal  the  evidence  as  to  wnether  the 
item  statistics,  particularly  on  the  TRK  items  in  separate  samples,  were  suffi¬ 
ciently  stable  for  reliance  in  setting  up  experimental  scales  for  subsequent- 
cross  validation.  The  question  vas  of  immediate  importance  in  regard  to  develop¬ 
ing  Trade  Knowledge  test  scales  in  MOS  samples  for  which  cross  samples  were  not 
available  in  the  present  study,  The  two  samples  on  vhich *Tool* Knowledge  item 
data,  were  obtained  afforded  an  opportunity  for  estimating  the  stability  of  item 
indices  obtained  in  such  relatively  small  MDS  samples.  Results  with  the  TK  test 
which  was  administered  to  both  A  and  B  samples  were  examined  +0  find  to  what  ex¬ 
tent.  the  same  items  were  identified  as  valid  in  two  samples  with  the  same  MDS 
criterion.  Sta clerical  significant  correspondence  vas  found  only  between  two  of 
the  larges+  samples  (.MDS  .120 )  (Table  4).  This  finding  suggested  that  sets  of 
items  identified,  on  single  small  samples  might,  veil  fail  to  maintain  validity  in 
an  independent  sampl° 
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Table  5 

NUMBER  OF  ITEMS  IN  TOOL  AMD  TRADE  KNOWLEDGE  TESTS 
SIGNIFICANTLY  VALID  (P  .05)  FOR  EACH  SAMPLE 


MOS 

Sample 

TK-1X 

TRK-1X 

Sample 

TK-1X 

TRK-1Y 

120 

A-l 

44 

23 

B-l 

56 

40 

310 

A -2 

47 

34 

B-2 

24 

33 

H 

OJ 

A-3 

29 

33 

B-3 

71 

39 

5LLa 

A -4 

33 

24 

B-4 

34 

23 

626a 

A -5 

22 

23 

B-5 

2  6 

12 

3 Inasmuch  as  a  imjority  of  cases  In  each  of  these  samples  were  In  the  MOS 
Indicated.,  the  MOS  is  used  to  represent  the  MOS  group  throughout  the  tables 
in  this  report. 


Table  4 

COMPARISON  OF  NUMBER  OF  TK  ITEMS  IDENTIFIED  AS  SIGNIFICANTLY  VALID 
IN  BOTH  OF  TWO  INDEPENDENT  SAMPLES 


MOS 

Number  of  Significantly  Valid  Items  In  Common 

F 

Samples 

Expected 

Observed 

Chi-Square 

.120 

A-l  vs  B-l 

24.64 

30 

5.76 

•  05 

310 

A -2  vs  B-2 

11..  28 

12 

.12 

- 

321 

A-3  vs  B-3 

20.59 

21 

.04 

- 

511 

A -4  vs  B-4 

11.22 

9 

(i.oo)a 

- 

626 

A-5  vs  B-5 

5-72 

9 

3.26 

.10 

While  the  Jet  analysis  had  suggested  grouping  the  MQS  In  the  categories  of 
Construction  [120  and  51l)  and  Electrical  ([310  and  321),  the  correlation  or  over¬ 
lap  of  Items  found  significantly  valid  (  05  level,  one-talled  test)  for  each 
separate  MOS  va6  inspected  for  additional  information  useful  to  the  grouping. 
Table  5  show?  the  correspondence.  In  items  identified  as  valid  in  every  possible 
pair  of  samples.  There  was  a  definite  trend  toward  better -than -chance  corres¬ 
pondence  between  se+s,  8  of  the  40  comparisons  showing  significant  [and  positive) 
correspondence  at  ’’he  05  level.  To  determine  whether  certain  MOS  sample  pairs 
yielded  consistently  better  correspondence  than  others,  however,  it  was  necessary 
to  S'im  the  '-hi  squares  across  all  four  sample -and-test  instances  Table  6  pre¬ 
sents  the  results  in  terns  both  of  chi  square  values  and  phi  coefficients  of 
correspondence  They  indicate  that  there  Is  a  significant  correspondence  be¬ 
tween  MOS  L20  and  both  321  and  51-1,  a  lesser  correspondence  between  MOS  310  and 
32.1,  and  a  borderline  correspondence  between  these  two  MOS  and  626.  Considering 
that  the  pbl  coefficients  represent  a  conservative  estimate  of  the  degree  of 
correlation  between  item  validity  indices,  the  findings  clearly  showed  That 
stable  scales  of  valid  item.?  cannot  be  expected  without  basing  them  on  multiple 
samples . 

In  general,  the  combination  of  MOS  indicated  by  the  job  analysis  was  sup¬ 
ported.  From  these  results,  MOS  321  could  have  been  included  in  either  the  Con¬ 
struction  or  the  Electrical  group,  a  plausible  finding  in  view  of  the  nature  of 
the  Lineman  s  duties.  Combining  the  Construction  Machine  Operation  MOS  (626  and 
627)  with  the  Construction  and  Utilities  MOS  was  initially  considered,  but  in- 
spe'tion  of  the  i^em  validity  coefficients  showed  that  there  was  little  correla¬ 
tion  between  +he  two  sets  of  coefficients.  Therefore,  MOS  626  and  627  were 
treated  as  a  separate  grou.p.  Decision  made  to  use  three  combinations  of 
MOS  ix  assembling  the  experimental  scales;  Construction ,  based  on  average  item 
validity  for  MOS  120  and  3 LI ,  Electrical,  bas°i  on  average  item  validity  for  MOS 
310  and  321,  and  General .  based  on  average  item  validity  across  all  five  MOS, 

In  al!..  twelve  scales  were  constructed.-- six  TK  and  six  TRK,  Three  scales  for 
each  measure  were  based  on  each  sample.  Owing  to  substantial  differences  in 
sample  size  simple  integral,  weights  approximating  proportions  of  cases  provided 
by  each  MOS  sample  In  each  combination  were  used  in  averaging  the  coefficients. 
These  weights  were  as  follows: 


A  Samples,  TK-IX  and  TRK-iX  MOS  120  and  321  (4),  MOS  310  and  626  (3), 

MOS  511  (2) 

B  Samples,  TK -IX  and  TRK-1Y :  MOS  120  (3),  MOS  321  (2),  MOS  310,  511, 
and  626  (.1) . 

Each  scale  was  composed  of  the  25  items  with  highest  average  validity  for  the 
MOS  combination  The  scales  are  shown,  with,  difficulty  levels  (p -values  on 
samples  A -6  and  B-6  combined)  and  validity  coefficients,  in  the  tables  in  the 
Appendix,  as  are  also  distributions  of  validity  coefficients  for  items  selected 
and  Items  rejected  for  each  scale.  Table  7  presents  median  p-values  and  medians 
of  average  validity  coefficients  across  the  MOS  included  in  each  scale.  Median  p- 
values  in  the  B  samples  averaged  08  higher  on  the  Tool  Knowledge  scales  than  in  A. 
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NUMBER  OF  ITEMS  IDENTIFIED  AS  VALID  IN  BOTH  OF  TWO  SAMPLES 
FOR  EVERY  POSSIBLE  TWO- SAMPLE  COMPARISON 
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♦♦Significant  at  .01  level 


Table  6 


COMPARISON  ACROSS  ALL  SAMPLES  AND  TESTS  OF  SETS  OF  VALID  ITEMS 
IDENTIFIED  IN  PAIRS  OF  DIFFERENT  MOS  SAMPIES 


Chi  Square 

MOS 

^10 

521 

2ii 

626 

120 

1.54 

18.67** 

14.19** 

(3-28)a 

310 

10.35* 

3.10 

7-68  (*) 

321 

3-71 

7-90* 

5U 

1.16 

Phi  Coefficient 

MOS 

2io 

221 

2ii 

626 

120 

07 

P*** 

• 

.20** 

-.10 

310 

.17* 

.09 

•15(*) 

321 

.10 

.15* 

511 

.06 

♦Significant  at  .05  level  £.1 -tailed  test) 

♦♦Significant  at  .01  level  (l-tailed  test) 

®Chi -square  In  parentheses  (  )  indicates  negative  relationship. 

k(*)  Narrowly  fails  .05  level  of  significance:  chi-square  of  7-78  required. 
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Median  p-values  for  TRK-1Y  (B  samples)  averaged  .14  higher  than  for  IRK- IX  ob* 
tained  In  A  samples .  There  was  also  a  tendency  for  the  Tool  Knowledge  items  to 
be  easier  than  the  Trade  Knowledge  items,  a  difference  possibly  ascribable  to 
the  pictorial  content  of  the  former  as  contrasted  to  the  greater  verbal  content 
of  the  latter.  Average  item  validity  coefficients  clustered  around  a  level  of 
.18  in  both  samples  and  on  all  tests.  The  Tool  Knowledge  items  were  slightly 
more  valid  than  the  Trade  Knowledge  items. 


Table  7 

MEDIAN  DIFFICULTY  AND  VALIDITY  OF  ITEMS  SELECTED 
FOR  MEC  HANICAL  KNOWLEDGE  SCALES 


Test 

Samj les 

Scale 

p -value 

Validity  Coeff. 

TK-1X 

A 

Construction 

.69 

.21 

A 

Electrical 

.62 

.18 

A 

'General 

.66 

.16 

B 

Construction 

.70 

.18 

B 

Electrical 

.72 

.24 

B 

General 

.80 

.16 

IRK -LX 

A 

Construction 

•  52 

.18 

A 

Electrical 

.56 

.16 

A 

General 

•  52 

•  15 

TRK-LY 

B 

Construction 

.67 

•  17 

B 

Electrical 

.68 

.20 

B 

General 

.67 

.16 
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SUMMARY  AND  CONCLUSIONS 

Three  experimental  information  teste,  the  Tool  Knowledge  Test  IK -IX  and  the 
Trade  Knowledge  Tests  TRK-1X  ami  TRF  1Y,  were  administered  to  two  general,  enlisted 
inpu+  samples  and  to  two  samples  each  of  five  electrical  and  construction  MDS. 

Item  analysis  yielded  25-item  scales  for  heavy  construction  MDS,  electrical  main¬ 
tenance  MOS ,  and  MOS  in  the  general,  mechanical  domain-  The  next  research  step 
is  to  obtain  unbiased  estimates  of  validity  of  the  scales  by  cross  validation  of 
the  Tool  Knowledge  scales  and  validity  generalization  and  estimates  of  shrinkage 
for  all  scales.  Information  on  the  potential  contribution  of  these  scales  as 
possible  replacement  tests  for  current  ACB  measures  such  as  Mechanical  Aptitude 
and  Shop  Mechanics  will  also  he  obtained. 
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APPENDIX 

Average  difficulty  levels  and  validity  coefficients  for  items  comprising  the 
12  scales  developed  for  Tool  Knowledge  and  Trade  Knowledge  tests. 
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Table  A-9 


DISTRIBUTIONS  OF  VALIDITY  COEFFICIENTS  OF  ITEMS  SELECTED  AND  ITEMS 
REJECTED  FOR  THE  CONSTRUCTION  SCAIES  OF  THE 
TOOL  KNOWLEDGE  TEST 


SAMPIES 

Validity  MOS  120 -A  MOS  120 -B  MOS  511-A  MDS  511 -B 


Coefficients 

Sel, 

Rej. 

Sel. 

Rej. 

Sel. 

Rej. 

Sel. 

Rej 

.45  to 

•  49 

2 

1 

40  to 

.44 

1 

1 

1 

35  to 

39 

0 

2 

2 

3 

-30  to 

34 

1 

1 

1 

3 

4 

4 

3 

.25  to 

.29 

6 

1 

1 

6 

0 

2 

4 

.20  to 

.24 

11 

4 

6 

2 

2 

14 

5 

12 

.15  to 

.19 

4 

15 

10 

8 

2 

12 

1 

6 

.10  to 

.14 

1 

11. 

7 

31 
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12 

4 

n 

.05  to 

•  09 

1 

27 

25 

2 
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1 

16 

.00  to 
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15 
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13 

3 

12 

-.05  to 

-  01 

11 

8 

10 

11 

*  10  to 

-.06 
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4 

8 

12 

-.15  to 

-.11 

1 

3 

6 

-.20  to 

-.16 

1 

-.25  to 

-.21 

1 

-.30  to 

-.26 

-•35  to 

-31 

-.40  to 

-.36 

TOTAL 

25 

95 

25 

95 

25 

95 

25 

95 

2 2 


-  8  - 


Table  A-iO 

DISTRIBUTIONS  OF  VALIDITY  COEFFICIENTS  OF  ITEMS  SELECTED  AND  ITEMS 
REJECTED  FOR  THE  ELECTRICAL  SCALES  OF  THE 
TOOL  KNOWLEDGE  TEST 


SAMPLES 

Validity  MOS  310 -A  MOS  310-B  MDS  321 -A  MOS  321 -B 


Coefficients 

Sel. 

ReJ. 

Sel. 

ReJ . 

Sel. 

ReJ. 

Sel. 

ReJ 

•  V?  to 

.49 

1 

40  to 

.44 

1 

1 

•  35  to 

-39 

2 

1 

3 

1 

2 

.30  to 

34 

3 

2 

5 

2 

5 

1 

25  to 

■  29 

5 

4 

4 

5 

1 

9 

1 

.20  to 

.24 

7 

9 

2 

3 

5 

1 

5 

9 

.15  to 

.19 

3 

17 

3 

9 

6 

2 

5 

16 

.10  to 

.14 

2 

22 

2 

26 

7 

16 

33 

.05  to 

.09 

1 

7 

3 

16 

6 

15 

16 

00  to 

.04 

13 

2 

6 

1 

35 

10 

-.05  to 

-.01 

10 

12 

15 

4 

-.10  to 

1 

b 

ON 

7 

3 

6 

3 

-.15  to 

-.11 

0 

7 

4 

-  20  to 

-.15 

1 

5 

-  25  to 

-.21 

2 

0 

-.30  to 

-.26 

0 

-•35  to 

-.31 

0 

-.40  to 

-.36 

1 

TOTAL 

25 

95 

25 

95 

25 

95 

25 

95 

Table  A-ll 


D IS TRIBUTIQNS  OF  VALIDITY  COEFFICIENTS  OF  ITEMS  SELECTED  AND  ITEMS 
REJECTED  FOR  fflE  CONSTRUCTION  SCALES  OF  THE 
TOADE  KNOWLEDGE  TEST 


SAMPLES 


Validity 

Coefficients 

MOS 

Sel. 

120  A 

Rej  . 

MOS 

Sel. 

120 -B 
Rej. 

MOS 

Sel. 

511 -A 

Rej. 

MOS  511 -B 
Sel.  Rej 

,50  to 

.54 

1 

.45  to 

,49 

0 

.40  to 

.44 

0 

1 

1 

•  35  to 

•  39 

1 

2 

1 

2 

.50  to 

•  34 

1 

1 

1 

2 

1 

2 

25  to 

.29 

4 

2 

0 

5 

3 

2 

6 

.20  to 

.24 

6 

3 

6 

0 

5 

8 

7 

10 

.15  to 

.19 

6 

4 

10 

5 

5 

8 

6 

7 

.10  to 

.14 

5 

14 

5 

IB 

3 

13 

5 

13 

.05  to 

-09 

1 

14 

1 

22 

1 

20 

3 

9 

.00  to 

.04 

1 

22 

23 

1 

9 

1 

14 

-.05  to 

-.01 

19 

9 

6 

9 

-.10  to 

-.0 6 

5 

4 

9 

6 

-.15  to 

-.11 

4 

3 

3 

5 

-.20  to 

-.16 

3 

1 

-.25  to 

-.21 

-•50  to 

-.26 

-.35  to 

-31 

-.40  to 

-.36 

TOTAL 

25 

85 

25 

85 

25 

85 

25 

85 
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Table  A -12 


DISTRIBUTIONS  OF  VALIDITY  COEFFICIENTS  OF  ITEMS  SELECTED  AND  ITEMS 
REJECTED  FOR  TEE  ELECTRICAL  SCALES  OF  THE 
TRADE  KNOWLEDGE  TEST 


SAMPLES 


Validity 

Coefficients 

MOS 

Sel. 

310 -A 
ReJ. 

MOS  310 -B 

Sel .  ReJ . 

MOS 

Sel. 

321 -A 
ReJ. 

MOS 

Sel. 

321 -B 
ReJ. 

45  to 

-49 

2 

40  to 

.44 

1 

2 

35  to 

•39 

0 

3 

1 

■  30  to 

34 

1 

6 

2 

.25  to 

29 

4 

2 

5 

8 

4 

.20  to 

.24 

7 

7 

3 

5 

3 

2 

8 

7 

.15  to 

•19 

5 

9 

1 

11 

8 

7 

1 

9 

10  to 

14 

4 

18 

2 

11 

12 

7 

7 

16 

.05  to 

•09 

1 

16 

1 

15 

2 

18 

2 

16 

00  to 

.04 

10 

10 

23 

14 

-.05  to 

-.01 

5 

1 

14 

17 

15 

-.10  to 

-.06 

11 

4 

6 

5 

-.15  to 

-  il 

5 

5 

4 

2 

-.20  -to 

-.16 

1 

1 

1 

1 

-.25  to 

“ .  cLl 

0 

-.30  to 

-.26 

1 

-.35  to 

-•51 

-  .1*0  to 

-.36 

TOTAL 

25 

85 

25 

85 

25 

85 

25 

85 

Table  A -15 

DISTRIBUTIONS  OF  VALIDITY  COEFFICIENTS  OF  ITEMS  SELECTED  FOR  THE 
GENERAL  SCALES  OF  THE  TOOL  KNOWLEDGE  TEST® 


Validity 

Coefficients 

120 

"A" 

SAMPLES 

626 

120 

"B" 

SAMPLES 

626 

310 

MGS 

321 

511 

310 

MOS 

321 

511 

.45  to 

-49 

1 

2 

1 

.  40  to 

44 

0 

X 

1 

1 

-35  to 

39 

1 

3 

2 

3 

2 

3 

•  30  to 

3^ 

1 

3 

2 

0 

1 

4 

4 

3 

-23  to 

.29 

5 

7 

5 

1 

1 

3 

6 

2 

1 

-20  to 

.24 

7 

5 

1 

3 

2 

2 

2 

6 

8 

5 

.13  to 

•  19 

7 

5 

6 

4 

3 

7 

2 

3 

0 

4 

•  10  to 

.14 

1 

3 

9 

3 

7 

10 

3 

3 

2 

2 

.0  3  to 

09 

4 

6 

1 

6 

4 

2 

1 

2 

1 

00  to 

.04 

3 

0 

2 

2 

2 

8 

-.05  to 

-.01 

0 

0 

2 

1 

1 

-.10  to 

-.06 

0 

2 

0 

1 

-.13  to 

-.11 

1 

1 

1 

-  20  to 

-  16 

1 

•  25  to 

-.20 

-  30  to 

-.26 

-.35  to 

-.31 

-  .40  to 

-.36 

TOTAL 

25 

25 

25 

25 

25 

25 

25 

25 

25 

25 

®For  any  given  sample,  the  total  item  validity  distribution  is  the  sum  of  the 
selected  and  rejected  frequencies  as  shown  in  Tables  A-9  through  A -12 .  The 
distribution  of  rejected  items  is  obtained  by  subtracting  these  distributions 
from  the  total  distributions. 
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Table  A-l4 

distributions  op  validity  coefficients  of  items  selected  for  the 

GENERAI  SCALES  OF  THE  TRADE  KNOWLEDGE  TEST8 


Trade  Knowledge  LX  Trade  Knowledge  1Y 

_ Samples _  _ Samples _ 


Validity 

Coefficients 

120 

310 

MIS 

321. 

511 

626 

120 

310 

MIS 

321 

511 

626 

5C  to 

y'4 

1 

45  "O 

42 

I 

c 

4c  t: 

V* 

2 

0 

2 

.  35  t : 

59 

1 

0 

2 

2 

1 

1 

3C  to 

•  34 

i 

i 

1 

2 

1 

1 

0 

2b  to 

29 

4 

3 

5 

2 

2 

6 

3 

2 

1 

20  to 

.2:4 

6 

3 

2 

4 

1 

5 

3 

9 

6 

4 

.15  to 

.19 

5 

h 

8 

3 

5 

8 

3 

3 

5 

2 

.10  to 

» 

5 

9 

jTf 

5 

6 

3 

6 

4 

3 

.05  to 

09 

1 

4 

b 

r\ 

3 

2 

1 

2 

1 

2 

CC  to 

-04 

2 

2 

I 

X 

5 

1 

2 

3 

4 

-.05  to 

-  .01, 

0 

.1 

2 

1 

1 

•  4 

-.10  to 

~.q6 

0 

I 

0 

1 

1 

3 

-  lb  to 

-.11 

1 

I 

C 

0 

-  .20  to 

-.16 

1 

1 

1 

-.25  to 

-.21 

-.  30  to 

-.26 

-•35  to 

-51 

-.40  to 

-.36 

TOTAL 

25 

25 

2b 

25 

25 

25 

25 

25 

25 

^For  any  given  sample,  the  total  item  validity  distribution  is  the  sum  of  the 
selected  ar.d  rejected  frequencies  as  shown  in  Tables  A -9  through  A-12,  The 
distribution  cf  rejected  items  is  obtained  by  subtracting  these  distributions 
from  tne  total  distributions. 
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